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CONSTRUCTION  OF  OPTIMAL  DESIGNS  TO  INCREASE  THE  POWER 


OF  THE  MULTIRESPONSE  LACK  OF  FIT  TEST 


M.  COORAY  WIJESINHA  and  ANDRE’  1.  KHURI 


Department  of  Statistics 
University  of  Florida 
Gainesville,  Florida  32611 

U.S.A. 


Abstract :  Two  design  criteria  are  introduced  to  improve  the  power  of  the 

multivariate  lack  of  fit  test  for  a  linear  multiresponse  model.  These 
criteria  are  extensions  of  the  Aj  and  A2~optimality  criteria  discussed  by 
Jones  and  Mitchell  (1978)  for  the  single-response  case.  A  procedure  is 
presented  for  the  generation  of  an  optimal  design  based  on  the  A£~ 
criterion. 

AMS  Subject  Classification:  Primary  62K05;  Secondary  62F03. 

Key  words  and  phrases:  Multiresponse  design;  Aj-optimality;  A2~optimali ty ; 
Multivariate  lack  of  fit  test. 

1 .  Introduction 

Detection  of  model  inadequacy  is  an  important  consideration  in  the 
modeling  of  a  multiresponse  function.  Khuri  (1985)  developed  a  multivariate 
test  for  lack  of  fit  for  a  linear  raul ti response  model.  The  test  provides  a 


comprehensive  assessment  of  the  adequacy  of  all  the  single-response  functions 
associated  with  the  multiresponse  model.  He  also  gave  a  procedure  for 
determining  which  responses  are  responsible  for  lack  of  fit  when  the  lack  of 


fit  test  is  significant. 

In  Section  2  we  introduce  some  notation  and  briefly  discuss  Khuri's 
(1985)  lack  of  fit  test.  In  Section  3  we  develop  two  design  criteria,  A^  and 
Ao-optimality ,  to  increase  the  power  of  this  test.  In  Section  4  an  iterative 
procedure  developed  by  Silvey  (1980)  is  used  to  obtain  A2~optimal  designs. 
Numerical  examples  are  presented  in  Section  5. 


2.  The  Multiresponse  Lack  of  Fit  Test 
2. 1  Notation 

Let  N  be  the  total  number  of  experimental  runs  and  r  be  the  number  of 
responses.  We  assume  that  each  response  depends  on  all  or  some  of  k 
controllable  variables  denoted  by  Xj ,X2» • • • ,x^.  The  fitted  ith  response  model 
is  represented  as 


E_(Y.)  =  X  8  ,  i 
a  ~i~i 


1,2,.*. ,r , 


(1) 


where  Y.  is  an  N*1  vector  of  observations  on  the  ith  response,  E  (Y  )  denotes 

r  »  a  ~i 

the  expected  value  of  Y^  under  the  fitted  model,  X^  is  an  Nxp^  matrix  of  rank 
p^  of  known  functions  of  the  settings  of  the  controllable  variables,  and  is 
a  PjXl  vector  of  unknown  parameters  ( i = 1 , 2 , . . . , r ) . 

We  suppose  that  the  model  for  the  true  ith  response  mean  (i=l ,2, . . . ,r)  is 
of  the  form 

VXi)  =  Zi&i  +  Mi*  1=1.2,. ..,r,  (2) 


where  Et(Xp  denotes  the  expected  value  of  under  the  true  model,  ^  is  an 
Nxq^  matrix  of  known  functions  of  the  settings  of  the  controllable  variables, 
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and  x±  a  vector  of  unknown  parameters.  If  the  fitted  model  (1)  is  correct, 
then  x±  will  be  equal  to  the  zero  vector. 

The  models  given  in  (1)  and  (2)  can  be  expressed  as 


Ea(X)  -  £B 

(3) 

Et(X)  -  U  + 

(A) 

where  Y  -  [ Yj  :  Y2 : . . . : Yr ] ,  X  =  [Xj :X2 : . . .  :X. ] ,  Z  =  [Z^.Z^....:^], 

B  -  diag(j3lt82,...,£r),  and  £  »  diag(^J  ,^2, . . .  .^  )•  The  matrices  £,  £,  £,  g, 

and  £  are  of  orders  Nxr,  Nxp,  Nxq,  pxr,  and  qxr,  respectively,  where 
r  r 

p  «=  j  Pif  q  =  ^E^  q^ ,  and  X  is  of  rank  p  (<p).  The  rows  of  Y  are 

independent  observations  from  multivariate  normal  populations  with  a  common 

nonsingular  variance-covariance  matrix  £  of  order  r*r.  Under  the  crue  model, 

Y  has  a  mean  given  by  (A)  and  a  variance-covariance  matrix  T  8  E. 

~  ~N  ~ 

For  the  development  of  the  lack  of  fit  test  we  assume  that  replicated 

observations  are  available  on  all  r  responses  at  some  points  in  the 

experimental  region.  Without  loss  of  generality,  it  will  be  assumed  that  such 

replicated  observations  are  obtained  at  each  of  the  first  n  design  points, 

where  1  <  n  <  N.  The  number  of  repeated  observations  at  the  ith  design  point 

is  denoted  by  >  2,  i  =  l,2,...,n)  and  the  total  number  of  repeated 

n 

observations  is  v  =  ^E^  . 

2.2  Khuri’s  (1985)  Lack  of  Fit  Test 

Let  £q  denote  the  matrix  which  consists  of  the  columns  of  X  that 
correspond  to  all  distinct  terms  in  the  r  fitted  models  given  in  (1).  The 
columns  of  span  the  column  space  of  X.  We,  therefore,  consider  that  Xq  is 
of  full  column  rank  equal  to  p,  the  rank  of  X.  Khuri  (1985)  developed  a 
multivariate  lack  of  fit  test  for  the  multi  response  model  (3)  using 
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emax^l^2  the  max^mum  eigenvalue  of  the  matrix  * ,  as  a  test 


statistic,  where 


Si  -  ntN-  VW'So  -  K>X 


Y"KY  . 


In  the  above  equations,  £  =  diag(Kj ,K2 , . . . ,1^, 0)  is  of  order  NxN  with  Q 

being  a  zero  matrix  of  order  (N-v)x(N-v)  and  =  I  -  (1/v  )J  ,  where  I  is 

i  i  i 

the  identity  matrix  of  order  v^xv^  and  >J,V  is  the  matrix  of  ones  of  order 

vixvi  ( i*l >2 > • • • ,n) .  Three  other  test  statistics  can  also  be  employed  to  test 

lack  of  fit;  they  are:  (1)  Wilks's  likelihood  ratio,  |  |  /  f  S  j_+  £2  | ;  (2) 

Pillai's  trace,  tr  [G^G^  g2)  *];  and  (3)  Hotel! ing-Lawley 's  trace, 

tr  (G.G.  * ) ,  where  I  I  and  tr  denote  the  determinant  and  the  trace  of  a 
~1~2  11 

matrix,  respectively. 


Development  of  Design  Criteria 


It  is  known  that  G0  has  the  central  Wishart  distribution  with 
~z 

n 

VpE  =  degrees  of  freedom;  is  independent  of  (J2  and  has  the 

noncentral  Wishart  distribution  with  =  (N-p-Vp^)  degrees  of  freedom  and  a 
noncentrality  parameter  matrix  given  by 


The  power  of  the  lack  of  fit  test,  based  upon  any  of  the  four  multi¬ 
variate  test  statistics  mentioned  earlier,  is  a  monotone  increasing  function 
of  the  eigenvalues  of  g  (see  Roy  et  al.  1971,  p.  68).  Therefore,  the  power  of 
this  test  can  be  increased  by  increasing  the  trace  of  Q.  However,  the  choice 
of  the  design  which  maximizes  the  trace  of  (1  depends  on  the  matrices  £  and  £ 
which  are  unknown.  Thus,  we  are  faced  with  the  problem  of  finding  an 
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expression  independent  of  £  and  £  which,  when  maximized,  results  in  an 
increase  in  the  trace  of  ft.  This  expression  is  found  as  follows:  It  is  easy 


to  show  that 


tr(8)  >  emln<r‘)  tr[r'Z'|l[i-X0(X'X0)‘1X'}zr],  I 

where  em^n  denotes  the  smallest  eigenvalue  of  the  matrix  inside  parentheses. 
Inequality  (7)  can  be  rewritten  as  (see  the  Appendix) 


where 


r  -  up  xp—'i;].  < 

&  -  z5{£N-£o<X6£o>_1X6tZo.  <> 

L  =  diag(H',H',...,H').  (] 

In  (10),  is  a  matrix  of  order  Nxp^(p^<q)  whose  columns  form  a  basis  for 
the  column  space  of  Z  =  [z ^ :Z^ : . . . :Z^ ] ,  Thus, 

~i  =  ~0~i  »  1  =  1,2 . . 


where  is  matrix  of  order  p^xq^. 

Since  em^n(£  *  )  is  a  constant,  the  maximization  of  the  quantity 

A  =  y"L  (I  0  A)  L'y  (13) 

r<*  rsj  /v  a#  >v 

will  result  in  an  increase  in  the  trace  of  Still,  however,  the  choice  of 

design  to  maximize  A  depends  on  %  which  is  unknown.  In  order  to  overcome  this 
problem  we  apply  the  maximin  method  proposed  by  Atkinson  and  Fedorov  (1975) 
and  used  by  Jones  and  Mitchell  (1978)  in  the  single-response  case.  The 
maximin  method  consists  of  choosing  a  design  which  maximizes  Ap  the  minimum 
of  A  with  respect  to  J  over  a  specified  region  n  in  the  ^-space.  The 
specification  of  the  region  n  depends  on  a  quantity  t  considered  as  a  measure 
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of  the  inadequacy  of  the  fitted  model  and  is  defined  as  follows:  Suppose  the 
uth  rows  of  and  Z.±  (i=l  ,2, . . .  ,r;  u=l,2,...,N)  in  (2)  can  be  represented  as 
f'(>0  and  ^(x^),  respectively,  then  the  fitted  and  true  response  functions 
associated  with  (1)  and  (2)  are  f'(x)0.  and  f'(x)B.  +  g'(x)y.  (1  =  1, 2,...,r), 
respectively.  We  express  x  as  x  =  jf"Tj£,  where 

T-diagtTj.Tj . T.)  UM 

with  Ti  =  i*22-  ^21^11^  ^12  and  the  4  =  are  the  re2ion  moment 

matrices  defined  by  =  S /  f ^(x)f '(x)dx ,  *>/  £i (x)g'(x)dx, 

^21  =  S-f  and  H.22  =  S/  where  S_1=  /  dx  and  x 

denotes  the  experimental  region.  This  is  a  multiresponse  extension  of  the 
expression  for  x  given  by  Jones  and  Mitchell  (1978).  It  is  a  measure  of  the 
inadequacy  of  the  fitted  models  given  in  (1)  and  is  positive  whenever  the 
fitted  model  is  inadequate,  otherwise,  it  is  equal  to  zero. 


3.1  A^-Optimality 

If  the  fitted  model  is  inadequate,  then  x  >  6  for  some  constant  6  >  0.  We 
define  it  =  *  $}•  The  first  design  criterion  is  to  maximize  A^  where 

A,  =  inf  {VL(I  0  A)  L'yl.  (15) 


This  is  a  multi  response  extension  of  the  A^-optimality  criterion  proposed  by 
Jones  and  Mitchell  (1978).  As  in  Jones  and  Mitchell  (1978),  Aj  can  be 
expressed  as 


A1  =  6  emin{l  lhllr  ®  &)L'}.  (16) 

A  design  which  maximizes  emin{T  *1.(1  0  A)l/}  is  called  a  Aj-optimal 

design.  Note  that  there  are  situations  in  which  emin(T  *L(lr  0  A)L'}  is  equal 
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to  zero  for  any  choice  of  design.  This  occurs,  for  example,  when  r(N-p)  <  q, 

r 

where  p  is  the  number  of  columns  of  JCq  and  q  =  q^  is  the  number  of  columns 
in  £  in  (A),  or  the  number  of  rows  of  the  matrix  ^  in  (11).  In  this  case  the 
rank  of  the  qxq  matrix  T  *L(I  0  A)L'  is  less  than  or  equal  to  r(N-p)  which  is 

~  -v.  ~r  ~  ^ 

less  than  q.  This  matrix  is,  therefore,  singular.  Thus,  Aj-optimal  designs 
can  only  be  obtained  under  certain  conditions.  This  leads  us  to  propose  a 
second  design  criterion  which  can  be  applied  in  more  general  situations. 

3.2  A2~0ptimality 

Our  second  design  criterion  is  to  maximize  A2,  the  average  of  A  (instead 
of  the  minimum  of  A)  over  the  contour  t  =  6,  i.e.,  we  propose  to  select  a 
design  which  maximizes 

h  •  I  9  *>l'l  »=/  /  dG.  07) 

*0  *0 

where  dG  is  the  differential  of  the  area  on  the  surface  of  the  ellipsoid 
TT0  =  { Y : ~  ^1*  Using  an  identity  stated  in  Jones  and  Mitchell  (1978,  p. 
544)  we  have  that 

A2  =  q_1 6  A',  where  A£  =  tr{T_1L(Ir  0  A)L'}.  (18) 

A  design  which  maximizes  Aj,  or  A^,  is  called  a  A2~optimal  (A^-optimal) 
design.  Since  q  and  6  are  constants  it  is  clear  that  A2~optimal  designs  and 
A^'optimal  designs  are  equivalent.  We  note  that  the  A2~opt imal i ty  criterion 
amounts  to  maximizing  the  sum  of  the  eigenvalues  of  T  *1(1^  0  A)L";  hence,  it 
can  be  applied  even  when  this  matrix  has  a  zero  eigenvalue. 

If  the  number  of  design  points,  N,  is  fixed  beforehand,  a  A2~optimal 
design  can  be  obtained  by  maximizing  A£  with  respect  to  the  Nk  design  setting 
(coordinates  of  the  N  design  points).  However,  this  may  lead  to  computa t ional 
difficulties  especially  for  large  values  of  N  or  k.  Therefore,  an  iterative 


procedure  by  which  design  points  can  be  chosen  one  at  a  time  would  be  quite 
desirable.  In  the  next  section  we  develop  such  a  procedure  by  using  single¬ 
response  optimal  design  theory. 

4.  The  Generation  of  A^-Optimal  Designs 

4. 1  Design  Theory 

Consider  the  single-response  model 

E(y  )  -  h'(x)6,  (19 

X  ^  ^ 

* 

where  y  denotes  the  response  value  at  a  point  jt  =  (x,  >  •  •  •  ,x,  )  ,  the 

elements  of  the  mxl  vector  h'(x)  are  functions  of  Xj , X2 , . • • .x^  defined  over 

some  experimental  region  x»  a  compact  subset  of  the  k-dimensional  Euclidean 

space,  and  0  is  a  vector  of  unknown  parameters.  We  assume  that  Var(y^)  =  o2 , 

Cov(y  ,y  )  =  0  for  x,  x. ,  x_  in  y(x,*  x„).  Let  H  be  the  set  of  all  design 
x.  x_  ~  ~1  ~2  ~1  ~2 

~2 

measures  defined  on  x*  Then  the  information  matrix  M(c)>  CeH  ,  is  defined  as 

M(0  =  /  h(x)h'(x)c(dx).  (20 

X 

The  family  of  matrices,M=  fM(0:4eH},  is  convex  (Silvey  1980,  p.  16).  By 
Caratheodory ' s  Theorem,  for  any  design  measure  c,  the  matrix  M(s)  can  be 
represented  in  the  form 

s 

M(c)  =  E.  A  h(x  )h'(x  ),  (21 

~  u=l  u~  ~u  ~  ~u 

where  x  ex  (u  =  1,2,. ..,s),  s  <  m'  =  [m(m+l)/2]  +  1,  and  0  <  A  <  1  with 
*S'U  u 

s 

Z.  X  =  1  (see  Silvey  1980,  pp.  15-16).  Thus,  for  a  given  M(^)eM  and 
u=l  u  ~ 

m  ** 

Xe(j=i\.\  -  such  that  0  <  X  <1  and  £  X  =  1 } 

1  i  ’  2  ’* *  *  ’  m'}  u  u=l  u  1 

there  exists  a  point  w'  =  ( ,x' ,x' , . . . ,x'„ )  in  U  x  xm  that  is  associated 
with  Note  that  in  A,  Au  =  0  for  s  <  u  <  ro'.  If  ^  is  a  real-valued 


function  bounded  from  above  on M 


then  a  design  measure  T*  is  said  to  be 


^-optimal  if 


♦lM(c*)]  =  sup  +[M(c)].  (22) 

Cetf 

Silvey  (1980,  ch.  4)  presented  an  iterative  procedure  to  obtain  <J>-optimal 
designs.  The  basic  idea  used  in  this  procedure  (Silvey  1980,  p.  29)  is  as 
follows:  Suppose  =  {x ^ ,x^ , . . . ,x^}  represents  an  N-point  discrete  design 
and  is  the  design  measure  obtained  by  attaching  the  mass  X^  = 

(u  =  1,2,...,N)  to  each  design  point  in  D^.  Start  with  an  initial  N^-point 
design  such  that  <J>  [ M(  C N  )]  >  -  00 .  Once  D^,  hence  i;^,  N  >  Nq,  has  been 
determined,  choose  the  design  point  x^j+i  suc^  that 


~(~N+1  ^~>(~N+ 1  ^  = 


(23) 


* 

where  for  M,,M„  in  M  ,  F.(M, ,M„)  is  the  Frechet  derivative  of  <j>  at  M,  in  the 
~1  ~2  9  ~1  ~2  ~1 


direction  of  M„  and  is  defined  as 
~2 


F  (M  ,M2)  =  lim+(l/e)[*{(l-e)M1+  eM  }  -  <j>(M  )].  (24) 

9  ~  e+O 

The  procedure  is  stopped  when  su^>  F^{m(5^,),  h(x)h'(x)}  is  less  than  some 
small  positive  preset  value  for  some  N"  >  Nq.  This  stopping  rule  is  based  on 
the  following  lemma  (Silvey  1980,  p.  22): 


Lemma  1 .  Let  4>  be  concave  on  M  and  differentiable  on  M  =  {m(^):  M(c)eM 
and  9fM(c)]  >  -  .  Suppose  a  <j)-optimal  measure  exists.  Then  £*  is 

^-optimal  if  and  only  if 

xe^  £(£)£/(£.)}  =  °*  (25) 

The  sequence  of  design  measures  {4^}  defined  in  the  iterative  procedure 
obeys  the  recursive  formula 


■N+l 


(1  aN)CN 


V^N+l^ 


(26) 


_  n 


where  ci^  =*  1/(N+1)  and  ?(j<N+i)  denotes  the  design  measure  which  assigns  1  to 
the  point  x^+j.  Silvey  (1980,  pp.  35-36)  shows  that  for  such  (a^)  the 
procedure  converges. 

Let  us  now  consider  the  multiresponse  model  given  in  (3)  and  the  A^- 
optimality  criterion  defined  in  Section  3.2.  We  shall  apply  Silvey's  (1980) 
procedure  to  construct  A^-optimal  designs.  For  this  purpose  let  us  consider 
the  matrices  Xq  and  £q«  which  are  of  orders  N*p  and  N*p^  and  appear  in  (5)  and 
(12),  respectively.  We  introduce  a  single-rer ponse  model  of  the  form  given  in 
(19)  with  h'(x)  =  [a^(x):  b>(x)],  where  a"*(x)  and  b'(x)  are  vectors  of 

~  »w  /v  /v  pw  /v 

dimensions  p  and  p^  that  represent  a  row  of  Xq  and  a  corresponding  row  of  , 
respectively,  evaluated  at  a  point  j.  The  corresponding  information  matrix 
for  a  discrete  N-point  design  measure  ?N  can  be  written  as 


Zbj  = 


~XX^N^  ~XZ^N^ 

-zz^n! 


(27) 


where  M^)  =  Xq/N,  M^)  -  Z^N,  =  Zj  X^N,  and 

Mzz(^n)  =  Sq  VN-  The  corresPonc^n8  expression  for  A^  in  (18)  can  now  be 
written  as  a  function  of  Mfr  ]  of  the  form 


<2S> 

where  a(cn)  -  Nl!izzUN)  “  -ZX^N^XX^N^-XZ^Nh  *  In  Seneral,  if  c  is  any 

design  measure  defined  on  a  compact  subset,  x>  of  the  k-dimensional  Euclidean 

space,  then  an  extension  of  the  A£  function  in  (28)  when  M  (?)  is  nonsingular 

'wAA 

is 

AJ[MCc>]  -  tr(T"'l{lr  f>  AfOlh'l.  <29) 

where  A<{)  -  -  Szx<«Hra(°Sxz( °  a0<i  Sxx<?)>  SxZU)l  KZXUK  an<i 

Mzz(?)  provide  a  partitioning  of  M(?)  in  (20)  analogous  to  that  of  m(?n)  in 
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(27). 


If  H  is  the  set  of  all  design  measures  on  x  and  M  is  the  set  {M(?):?tH}> 
then  a  real-valued  function  4>  can  be  defined  on  ^  as 

A'[M(?)]  if  M  (?)  is  nonsingular 
<p  [M(  ?  )  ]  =  (30) 

-  <»  otherwise. 

In  this  respect,  the  problem  of  finding  a  A^-optimal  design  for  a 
multiresponse  model  is  equivalent  to  finding  a  <{>-optimal  design  for  the 
single-response  model  (19)  with  h'(x)  =  [a'(x):  b^(x)]  as  was  seen  earlier. 

The  function  <|>  defined  in  (30)  can  be  shown  to  satisfy  conditions  (i),  (ii), 
and  (iii)  described  in  Theorem  1.  The  proof  of  this  theorem  is  given  in 
Wijesinha  and  Khuri  (1985). 

Theorem  1.  Let  M  '  =  {m(?):  M(?)eM  and  ^^(C)  *s  nonsingular}.  If  A'llK?)] 
is  defined  as  in  (29),  then 


(i)  a  A^-optimal  measure  exists, 

(ii)  A^  is  concave  on  M. 

* 

(iii)  A^  is  differentiable  on  M  . 


If  F^  denotes  the  Frechet  derivative  of  A£, 


then  from  Lemma  1  and 


Theorem  1  we  may  conclude  that  a  design  measure  ?*  is  A^-optimal  if  and  only 


where  h'(x)  =  [a'(x):  b^(x)].  This  result  will  be  used  to  construct  a  A^~ 
optimal  design  in  an  iterative  manner,  just  like  in  Silvey's  (1980)  procedure 
described  in  Section  4.1.  First,  we  need  to  obtain  an  explicit  expression  for 


This  will  be  developed  in  the  next  theorem. 
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•! 


Theorem  2.  If  H  is  the  set  of  all  design  measures  on  x>  then  for  £e  H  and 
xex  we  have 

F.^{M(s),  h(x)h" (x) }  =  tr[T  ^{i  0  [b(x)  -  v(x, ?) ) [b'(x)  -  v'(x,c)]}l'] 

A  /v  A/  /V  *  L  A<  rv  ‘rvr  ry  A/  (V  #V*  A/  aw  A/  (V  ^  A/  j 

2 

-A'[H(?)1,  (3 

where  v(x,0  =  M  (?)M  ^(c)a(x)  and  h(x)  =  [a'(x) :b'(x) ] 

~  ~  ~zx  ~xx  ~  ~  ~  ~  ~  ~  ~  ~ 

Proof .  For  simplicity  we  shall  write  JI  and  h  instead  of  M(^)  and  h(x).  By 


definition , 


&'>  =  lim  <l/e){A'[Mj  -  A'[M]}, 
2  e+0 


where  M  =  (l-e)M  +  ehh'.  Recall  that 


Therefore , 


where 


»;t«!  -  ‘til,  8  («Z2-  tt2xB^ttxz)!i']' 


FA'<M.  K>'>  -  “■+"(!  yjL  »  E)L'}, 


e  -  a/c)(Szz-  B22Bxx^xz  -  V  Hzx^fcxzl- 


M  M 
~XX  ~XZ 


~ZX  ~ZZ 


But  from  Dykstra  (1971),  for  a  nonsingular  matrix  £  we  have  the  following 


identity: 


A_1  -  A_1 

,  ,  A  xx  A 

, ,  .  „*-l  .-I  ~  ~0~0  ~ 

(A  +  x  x  )  =  A - : -  . 

~  ~0~0  ~  „  .-1 

1+  x  A  x 

~U  ~  Aw(j 


Thus,  if  we  let  A  =  (l-e)Mvv  and  x  = 
~  ~XX 


Mx^  =  iO-e)M  xx+  eaa'}‘ 


v2 

E  4  a ,  we  get 


-  ‘“-£>  aja'  {«/<'-*>  S£%X’ 

where  c"1  -  1  +  [e/(l-r)]  a'H vl  a.  Xt  follows  that 

~  ~XX  ~ 

Sx  "  (1_e)~ISxX  '  where  c  =  1  -  e  +  ea'M^a  and  P  =  aa'M^. 

From  (33)  we  obtain 

£  “  "~ZZ+  ~ZX1~XX~XZ+  ^  ”  -ZX^XX  —  “  —  ~XX^XZ 

"  {e/(l-e)}ba'M^  ab'  +  {(l-e)/t}MzxPMxz 

+  (e/t)M  Pab'  +  ( e/ t )ba"PM  „  +  {e2/ [ ( 1-e) t ] }ba'Pab' .  (34) 

'w2X'V*VA'  'V»>'X4  1  *  r-^rsj 

From  (32)  and  (34^  we  conclude  that 

V{M(S), 

2 

-  tr  [T_1l{  Ir  8  [b(x)  -  v(x,C)][b-(x)  -  v'(x,c)]}L']  -  A£[M(c)l. 
where  v(x,?)  =  Mzx(c)M^(4)a(x). 

4.2  An  Iterative  Procedure  to  Obtain  a  A^-Optimal  Design 

Let  h(x)  =  [a'(x) :b"(x) ) "  and  let  N  >  1 ,  be  defined  as  in  (27). 

The  main  steps  of  the  iterative  procedure  for  constructing  a  A^-optimal  design 


1.  Start  with  an  initial  design  (consisting  of  Nq  points)  for  which 
)  is  nonsingular. 


2.  Obtain  the 


attained . 


design  point  x._  at  which  sup  F.^fMfj;.,  ),  h(x)h  (x)l  is 
~N„+1  x£Y  A_l~'  N  '  ~  ~  ~  ~  ’ 

0  ~  2  0 


3.  Obtain  dn^+i  (hence  4^+1  ^  augmenting  Djj  with  Recall  that 

+j  is  the  design  measure  obtained  by  assigning  probability  1/(Nq+1)  to 


each  design  point  in  DN  +,. 


4.  Continue  this  process  to  find  £^+2’  X^q+3 . until 


for  some  N  >  Nn  and  e,  where  e  is  a  small  positive  number  chosen  a  priori. 


5.  Numerical  Examples 


Example  1.  One  of  the  main  concerns  in  industry  is  the  determination  of 


conditions  on  the  controllable  variables  which  lead  to  better  yields  and  lower 


costs.  In  a  paper  by  Lind  et  al.  (1960),  the  authors  discussed  a  case  study  of 


such  a  problem.  They  applied  response  surface  techniques  to  a  typical 


chemical  processing  operation.  Three  controllable  variables  were  considered; 


they  were  x^,X2»  and  x^  which  represent,  respectively,  the  proportions  of  two 


complexing  agents,  and  the  extraction  pH  level.  The  response  variables  were 


yj  =  percentage  yield,  y2  =  cost  of  materials  (dollars  per  one  kilogram  of 
product).  The  controllable  variables  were  coded  so  that  -1<X^<1  (i=l ,2,3). 


The  fitted  models  are  given  below 


Ea^l>  "  ho  *  jilVj  +  SU2V2  +  Sil3XlX3  +  8123X2X3'  1  ’  I-2' 


If  these  models  are  inadequate,  then  it  is  necessary  that  the  design  be  chosen 


so  that  the  experimenter  can  quickly  and  efficiently  detect  the  presence  of 


lack  of  fit.  In  this  case  the  design  can  be  augmented  with  additional  points 


to  allow  the  fitting  of  models  with  higher-order  terms.  If,  however,  no 


significant  lack  of  fit  is  detected,  then  the  models  can  be  used  to  determine 


conditions  on  x^.Xj,  and  x^  that  lead  to  high  yield-response  values  and  low 


cost-response  values.  Let  us  consider  that  the  true  model  for  each  response 


Is  of  the  second  degree  with  all  pure  quadratic  terms,  i.e.,  x^,  x|,  and  x^ 
(this  model  was  reported  to  be  adequate  according  to  the  study  by  Lind  et  al., 


1960). 


MVc.'.i’A'A'iVA 


_■  -v* w«  w.« *u* wj»  *v* nr.  ^  -* tv* rrj+r-rj-r  fr+.  rjYJ\  >  s'C 


The  iterative  procedure  described  in  Section  4.2  was  carried  out  using 

two  initial  designs  given  in  Tables  1  and  2.  The  augmented  design  points,  the 

sup  F,.  values,  and  the  AX  values  are  given  in  Tables  3  and  4.  The  figures 
xe*  A2  ’  2 

indicate  that  the  procedure  has  been  successful  in  reducing  the  values  to 
a  level  very  close  to  zero.  A  steady  increase  in  the  values  of  A£  is  also 
seen.  It  is  quite  clear  from  these  results  that  the  choice  of  the  initial 
design  has  a  significant  effect  on  the  location  of  the  new  design  points  as 
well  as  on  the  rate  of  convergence  of  the  procedure. 

Example  2.  In  this  example  we  consider  a  multiresponse  experiment  with 
three  responses,  y^ ,  y2>  y3>  and  three  controllable  variables,  x^ ,  X2 ,  x^, 
coded  so  that  -1  <  x  <  1  ( i= 1,2,3)  .  The  fitted  models  are 

Ea*yl*  =  B10  +  B11X1  +  B13X3  +  6113X1X3 

Ea(y2)  "  B20  +j=lB2jXj  +  B213X1X3  +  B211X1  +  B233X3 

Ea(y3)  =  830  +jE1B3_jxJ. 

The  true  models  are  considered  to  be 

W  =  B10  +  Bllxl  +  B13X3  +  B113X1X3  +  B111X1  +  6133X3 

EtCy2)  =  620+j=lB2jXj+8213XlX3+B2IlXl+B233X3+6212XlX2+6223X2X3+B222X2 

Et(y3)  *=  83o+jIl83jXj+B312XlX2+B313XlX3+B323X2X3+B311Xl+B322X2+B333X3 
The  initial  design  for  this  example  Is  given  in  Table  5  and  the  augmented 

design  points  are  given  in  Table  6.  As  in  Example  1,  we  can  clearly  see  that 

the  proposed  procedure  has  been  effective  in  reducing  the  value 

of  sup  F,,[M(c.r  . ) ,h(x)h'(x) ]  to  a  level  arbitrarily  close  to  zero. 


Appendix 

In  this  appendix  we  prove  the  inequality 

tr(fl)  >  e  ,  (E_1)y"L(I  «A)L'y, 

where 


f  -  a  -  55  UN-Xotw'1^1  ?o- a,>d 

L  -  diag(HjfH^,...,H-). 

Proof 

"[rrUN-y%Jo>"‘x5iH] 


U.l) 


-  (xi  »;■  xi  S2;---:x;  s;]ar»  a>(x;  »r=x£ 


-  y"  l(i  0  A)  1/y- 

Aj  /V  Aw«]r  (V  ^  /w 

Inequality  (A. 1)  follows  from  the  above  equality  and  inequality  (7). 
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Table  1.  Initial  Design  1  (Example  1). 


X1 

x2 

x3 

1 

1 

1 

1 

1 

-1 

1 

-1 

1 

1 

-1 

-1 

-1 

1 

1 

-1 

1 

-1 

-1 

-1 

1 

-1 

-1 

-1 

Table  2.  Initial  Design  2  (Example  1). 


1^5  FA-  t~(^N-l)’ 
**  2 


^2 


(-0.019,-0.008,-0.003) 

67.4805 

0.0000 

(  0.008,-0.001,-0.001) 

4  .6655 

6.6644 

(  0.006,  0.006,  0.011) 

32.4011 

10.7976 

(-0.002,  0.002,-0.009) 

22.3158 

13.3860 

(  0.007,  0.003,  0.016) 

14.9971 

14.9977 

(-0.004,  0.011,-0.009) 

9.5850 

15.9737 

(  0.003,  0.012,  0.004) 

5.5106 

16.5279 

(-0.001,  0.000,-0.005) 

2.4048 

• 

16.7973 

(  0.000,-0.002,  0.000) 

0.0050 

16.8726 

Table  4. 


The  Augmented  Design  Points  Using  Initial  Design  2  (Example  1). 


N 

~N 

sup  F  [M( C  ,),  h(x)h ' (x) ] 
xex  A2  ~  ~  ~  ~  ~ 

8 

(-1.000,-1.000,-1.000) 

92.7738 

0.0000 

9 

(  0.880,-1.000,  0.280) 

43.3311 

2.1245 

10 

(-1.000,  0.891,  0.382) 

40.6232 

3.5374 

11 

(-0.241,-0. 182,-0.089) 

23.1349 

4.7762 

12 

(  0.902,  0.991,  0.881) 

41.9346 

6.6435 

13 

(-0.140,-0.079,-0.040) 

17.9048 

7.2794 

14 

(-0.139,  0.881,-1.000) 

20.2792 

8.4975 

15 

(-0.135,-0.060,-0.041) 

12.8134 

9.0801 

16 

(  0.878,-0.223,-1.000) 

14.6284 

9.8342 

17 

(-0.120,-0.061,-0.059) 

9.5272 

10.1154 

18 

(-0.124,-0.063,-0.058) 

6.7563 

10.6228 

19 

(  0.879,  0.900,-0.100) 

11.9147 

10.9438 

20 

(-0. 161,-1.000,-0.079) 

5.7707 

11.1739 

21 

(-1.000,-0.019,  0.025) 

5.0655 

11.3401 

22 

(-0.120,-0.060,-1.000) 

4.0475 

11.4226 

23 

(  0.920,-1.000,  0.890) 

11.0403 

11.5733 

24 

(  0.883,-1.000,-1.000) 

7.9772 

11.5312 

25 

(  0.043,-0.123,-0.043) 

5.0573 

11.5236 

26 

(  0.045,-0.124,-0.045) 

3.5450 

11.6986 

27 

(-1.000,  0.891,-1.000) 

7.0004 

11.8117 

28 

(-1.000,-1.000,  0.880) 

10.2624 

11.8081 

29 

(-0.060,-0.120,-0.047) 

4.1023 

11.8672 

30 

(-0.100,-1.000,-0.040) 

2.9559 

11.9892 

31 

(-0.059,-0.119,-0.039) 

2.4101 

12.0441 

32 

(  0.001,-0.009,-0.011) 

1.0677 

12.1065 

33 

(-0.003,-0.004,-0.000) 

0.0156 

12.1256 

Table  6.  The  Augmented  Design  Points  for  Example  2. 


8 

(-1.000,-1.000,-1.000) 

311006.8974 

-0.0000 

9 

(-1.000,  0.880,  0.901) 

496.1313 

0.6116 

10 

(-1.000,  1.000,-1.000) 

239.7514 

0.8424 

11 

(  0.620,-1.000,-1.000) 

101.2637 

4.0733 

12 

(-1.000,-1.000,  1.000) 

132.6938 

7.4027 

13 

(  1.000,  0.995,  1.000) 

118.0638 

8.5210 

14 

(-1.000,-1.000,-0.120) 

74.6300 

8.3795 

15 

(  1.000,-1.000,-1.000) 

45.3371 

10.4716 

16 

(-1.000,  0.880,  1.000) 

24.9710 

11.6581 

17 

(-1.000,-1.000,  0.995) 

21.1408 

12.0597 

18 

(-1.000,  0.880,-1.000) 

10.7567 

12. 1594 

19 

(-1.000,-1.000,-1.000) 

8.2219 

12. 1818 

20 

(  1.000,-1.000,  0.894) 

38.5043 

12.1063 

21 

(  1.000,  1.000,  1.000) 

27.2943 

12.7122 

22 

(  1.000,-1.000,-1.000) 

13.3531 

13.1270 

23 

(-1.000,  0.880,  1.000) 

10.5090 

13.2994 

24 

(-0.940,-1.000,  0.899) 

5.3225 

13.4066 

25 

(  1.000,  1.000,-1.000) 

23.0393 

13.3929 

26 

(-1.000,  0.898,-1.000) 

7.5010 

13.8408 

27 

(-1.000,-1.000,-1.000) 

5.2012 

13.8770 

28 

(  1.000,-1.000,-1.000) 

10.8382 

13.8495 

29 

(  1.000,-1.000,  1.000) 

25.5676 

14.0416 

30 

(  1.000,  1.000,  1.000) 

15.4512 

14.2208 

31 

(-1.000,  0.894,  1.000) 

7.0110 

14.3827 

32 

(-1.000,-1.000,  0.880) 

5.9191 

14.4395 

33 

(-1.000,-1.000,  1.000) 

1.5645 

14.4925 

34 

(  1.000,  1.000,-1.000) 

16.9589 

14.3978 

35 

(-1.000,  1.000,-1.000) 

10.7206 

14.6391 

36 

(-1.000,-1.000,-1.000) 

4.4119 

14.7352 

37 

(  0.910,-1.000,-1.000) 

3.8760 

14.7178 

38 

(  1.000,-1.000,  1.000) 

16.9927 

14.7342 

39 

(  1.000,  1.000,  1.000) 

11.9193 

14.8585 

40 

(  1.000,  1.000,  1.000) 

1.8782 

14.9712 

41 

(-1.000,-1.000,-1.000) 

1.0772 

14.9461 

42 

(  1.000,-1.000,-1.000) 

.01425 

14.9103 
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